Create a new custom import profile

Aim

To import external data as ASCII files when EthoVision XT does not have a predefined import profile (see step 4 in Import a complete external data file at once). With an import profile you create a template based on the structure of the external data file.

Prerequisites

Your license for EthoVision XT includes the External Data Module

You exported your external data as ASCII files.

Procedure

1.Choose Setup > Import External Data.

2.Click the Custom Import Profiles button and then the New button.

3.Browse to the external data file.

4.Build the import profile by specifying the structure of the data file. This is done by dragging and dropping cells. To make a selection undone, select the cell to which content was dropped and press Delete.

Follow the procedure in these sections:

1 - Header

2 - Delimiters

3 - Time information

4 - Data

5.Import a text file with the new import profile

The numbers in this figure correspond with the numbers of the headers in the text below.

inset_800529.jpg 

1 - Header

EthoVision XT usually automatically detects header and data information in the file. If not, specify which part of the data file contains the header. Choose an option from the Header detection list:

Automatic (default). EthoVision XT is set to automatically detect the header and data sections in the data file. Choose one of the other options if automatic header detection does not work.

Specify tag. Select this option if the data file has a variable number of header lines and the header always ends with the same word. Specify the phrase (with either nominal or numerical information) that indicates the end of the header part of the file. If necessary, also specify the number of rows between the header line that contains this phrase and the data.

example  The header always ends with a line containing the text [Data]. After the line with this text there is always an empty line before the data starts. Enter [Data] in the End tag field and 1 in the Extra rows field.

Specify row number. If the data file always has the same number of rows in the header, select this option and specify the number of header rows.

2 - Delimiters

EthoVision XT uses the comma as the default delimiter to separate text in the header and data sets. However, the data file may have other delimiters. If this is the case, select the correct ones from the Select header delimiters and Select data delimiters lists. You can also select multiple delimiters.

Some DAQ software enables you to select the type of delimiter when saving the DAQ data to an ASCII export-file. In that case you select the same delimiter in the File content section of the Profile Definition window. A comma or semicolon are advised as delimiters.

inset_900530.jpg 

3 - Time information

Specify which cell or column contains the time information. This can be a column with time stamps, a cell with the sample rate, or a cell with the sample interval, which is the time between samples. Drag and drop the cell or column with time information to the appropriate field in the Profile definition section.

1.Sample rate. If the header contains a cell with the sample rate, select the Sample rate button under Timing based on in the Profile definition section. Drag the cell with the sample rate to the Sample rate box and select the appropriate unit (Hz or kHz) from the list.

inset_1000531.jpg 

2.Sample interval. If the header contains a cell with the sample interval, select the Sample interval button in the Profile definition section. Drag the cell with the sample interval to the Sample interval box. Select the unit of time from the list.

inset_1100532.jpg 

3.Time series. If the header does not contain information on sample rate, select the Time series button under Timing based on. Under Data sets in the File content section, select the column with time stamps and drag this to the Time series box. The column with time stamps now appears grayed.

inset_1200533.jpg 

The Select Time Format window opens. If the time matches one of the predefined formats, EthoVision XT automatically selects one. Converted time shows the conversion of the text to time and Conversion is OK.

You can also define your own format by typing an H for each number representing 'hour', an m for 'minute', an s for second and a f for each decimal of a second (see the next picture).

inset_1300534.jpg 

Under Import Time, select one of the options.

Relative to time zero. Suppose the first row in the imported external data set has time 00:00:05. When the option Relative to time zero is selected, the time stamp of the first row of the imported data set will remain 00:00:05.

Relative to the time of the first data line. Suppose the data set you want to import starts at 14:28:00 and has samples every 5 seconds. With the option Relative to the time of the first data line, the first row of the imported data will get the time stamp 00:00:00. The second row will have time stamp 00:00:05. The options under Import Time are grayed out when your time stamps contain the date the file was created. In this case the option Relative to time zero is used.

Select the option Allow timestamps to be non equidistant when the time stamps do not represent regular intervals. For example, 0, 490, 572, etc...

4 - Data

Under Data definition in the Profile definition section there are two parts. The lilac part is labeled Header Data where you drag cells to from the lilac Header section. The green part is labeled Raw data where you drag Data sets to from the green cells in the Data sets section.

1.Drag the first column under Data Sets to the first empty cell in the Raw data - Data Set column. As a result, the letter of the original column appears in the cell and the column in the Data Sets section is grayed.

inset_000535.png 

2.Now locate the data set name, the unit and, optionally, other information in the header and drag those cells to the Header data cells in the same row.

inset_100536.png 

If you drag and drop the Start Date and/or Start Time a window opens in which you can define the format. Accept the default format, or see step 3 of 3 - Time information for the procedure to change it.

Multiple data sets

1.Follow the procedure above to define the next dataset. Once two datasets are defined, the Validity Check button becomes active.

2.Click this button. EthoVision XT now automatically fills the other rows in the Data definition field.

inset_1400537.jpg 

3.Check that the correct columns are selected.

How the Validity check is applied

EthoVision XT assumes that your header and data set info are ordered in a regular way in your external data file (e.g., left-right, with/without empty cells in between).

example  Your external data file contains four Data Sets in columns A, C, E and G. Columns B, D, F are empty. When you drag columns A and C to the first two rows in the Raw Data column and next click the Validity Check button, EthoVision XT automatically assigns columns E and G to rows 3 and 4, thereby taking into account the empty columns between Data Sets.

The distance between the columns should be the same. For example, dropping columns A and C and clicking Validity Check works. The columns E, G, I, K etc are automatically added to the other rows. Dropping columns A and B, and clicking Validity Check also works. All other columns are then automatically added to the other rows. However, dropping A, B, and D and clicking Validity Check does not work, because there is an empty column between B en D, but not between A and B.   

inset_200538.png 

Data sets with missing samples

If your data set contains missing samples indicated by non-numeric symbols, specify this symbol and select the Treat as number checkbox.

inset_1500539.jpg 

Alternatively, click the button next to the Treat at number field to select one or more predefined symbols. To select a specific text, click <User Defined>, click OK and enter this text after a comma (,).

If text is identified by a character, select this from the Text qualifier list.

Save the import profile

When all the information is in the Import Profile Definition sheet, click the Save As button and give the profile a name.

Import a text file with the new import profile

The newly created import profiles is now in the Files of Type list.

1.Locate the external data file and select the filename.

2.Click Open.

Notes

A missing sample is converted to a ‘zero’. As a result, it is plotted as a ‘zero’ in the Visualization.

The import profile is stored with the extension *.eip.